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ABSTRACT 



The Schools and Staffing Survey (SASS) and the Teacher 
Followup Survey (TFS) have been administered by the National Center for 
Education Statistics (NCES,) in 1987-88, 1990-92, and 1993-95. The SASS is a 
large-scale survey of educational institutions in the United States. The TFS 
is conducted the year following the SASS to obtain more information about 
teachers at the sampled schools. In preparation for the next round of the 
SASS, the NCES decided to reassess the design of the NCES. This paper 
reconsiders the goals, foci, and strategies of SASS and continuing and new 
questionnaire content. A particular concern is the data NCES should collect 
to inform the educational issues most likely to be of concern in the next 10 
to 20 years. The brief answer is that the NCES should continue to collect the 
data relevant to the fundamental dimensions of public schooling and the 
dimensions of the teaching force that have been considered in the past. To be 
prepared for the next decade, the NCES should collect data to quantify the 
baseline status of schools and their staffs so that changes in issues of 
interest can be recognized easily. In the past, SASS data have been 
especially useful for problem definition, evaluation of policies and 
programs, and also for enlightenment, and for enlightenment. In the future, 
it is recommended that questionnaires be designed to continue to collect 
useful data for these purposes and in addition to collect data more useful 
for evaluation of policies and programs. The following sections are included 
in the report: (1) "Introduction"; (2) "School Improvement versus School 

Change"; (3) "The Goals, Foci, and Strategy of SASS: A Reconsideration"; (4) 
"Dimensions of Schooling Amenable to Policy Intervention"; (5) "Review of 
Prior SASS Questionnaires"; (6) "Discussion and Recommendations"; and (7) 
"Summary." (Contains 2 tables and 14 references.) (SLD) 
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I. INTRODUCTION 



The Schools and Staffing Survey (SASS) and the Teacher Followup Survey (TFS), a 
longitudinal component of SASS given in the subsequent year, have been administered by 
the National Center for Education Statistics (NCES), the U.S. Department of Education, 
during three different time periods: 1987-89, 1990-92, and 1 993-95. 1 Though NCES has 
made incremental improvements in SASS 2 between administrations and supplemented the 
basic SASS with additional questionnaires addressing special topics such as Indian 
education and library issues, there has been intentionally a great deal of continuity in the 
content of the several SASS questionnaires to permit the study of trends over the six-year 
period of SASS. 

In preparation for the next administration of SASS/TFS scheduled for 1 998-2000, 
NCES has decided to reassess the design of SASS, including questionnaire content and 
related matters such as the possible linking of SASS to other NCES surveys which collect 
student background and achievement data. This reassessment is subject to the con- 
straints that (a) SASS will continue to be a cross-sectional survey based on national 
probability samples, (b) the focus of SASS will continue to be on schools, including their 
staffing, at the elementary and secondary levels, and (c) changes to the content of SASS 
should not increase the burden on respondents completing SASS questionnaires (i.e., any 
new content will have to be counterbalanced by selective deletions of old content). 



'This paper assumes that the reader is familiar with background information about SASS. In 
brief, SASS is a large-scale cross-sectional survey with different questionnaires being administered 
to independent national probability samples of local education agencies (LEAs), schools, principals, 
and teachers in the public sector (variations of the questionnaires for schools, principals, and 
teachers were administered in private and Indian schools). In the public sector, schools are 
sampled first, and teachers are sampled within the schools. In addition, the principals for the 
sampled schools and the LEAs in which the schools are nested are included. Thus, responses to 
the several questionnaires can be linked. During the year following a SASS administration, TFS 
is administered to three subsamples of teachers as follows: (a) teachers who continued to teach 
in the same school as in the SASS year, (b) teachers who transferred to a different school in year 
after SASS, and (c) teachers to left the teaching profession at the end of the SASS year. 
Descriptive information about SASS and TFS is available from NCES. 

^Throughout this paper, references to SASS alone imply SASS and TFS. 
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As a contribution to NCES's current reassessment of the design of SASS, this paper 
will consider future questionnaire content in broad scope with respect to how the Survey 
can best inform education policy issues pertaining to schools and their staffing-especially 
important issues that may emerge over the next two decades. Specifically, the objectives 
of this paper are to: 

1 . Reconsider the goals, foci, and strategy of SASS, taking into account the original 
framework established in the mid-1980s and SASS's potential to inform broad 
education policy in the future. 

2. Identify potential new areas of questionnaire content related to schooling that are 
likely to be of importance to education policy issues in the future. 

3. Review the content of the most recent (i.e., 1993-94) SASS questionnaires in 
light of (a) the existing balance between teacher supply and demand content and 
other school content, (b) the extent of coverage of particular topics that appears 
to be excessive or the coverage of topics that appears to be of relatively low 
priority, and (c) redundancy across questionnaires. An outcome of this review 
will be the determination of questionnaire content that can be compressed or 
deleted to accommodate expansion in other content areas. 

4. Recommend priorities among potential new content areas and essential areas 
from past SASS administrations that might be included in the 1998-99 adminis- 
trations of SASS. The focus will be on factors determining the nature and quality 
of schooling that are amenable to education policy interventions, as distinguished 
from aspects of the broader social, economic, and political contexts which also 
shape the form and functions of education within society. 

Two caveats involved in the pursuit of these four objectives should be noted. First, 
the emphasis will be on schools in the public sector because policy formation in education 
applies predominantly to public schools. Second, data collected by SASS should be 
relevant to education policy assessment and decisions at any level, because the mix of 
federal, state, and local influences on schooling has been in gradual flux and is expected to 
continue to change. 



II. SCHOOL IMPROVEMENT VERSUS SCHOOL CHANGE 



In preparation for the fourth administration of SASS in 1 998-99, NCES is now recon- 
sidering the value of continuing to emphasize teacher supply and demand data in contrast 
with other data that may contribute more toward school improvement. Specifically, NCES 
asked, in commissioning this paper, "What nationally-representative schools and school 
process data will inform our thinking about and work toward improving schools in the next 
10 to 20 years" (emphasis added). Given this task, possible changes in the goals, foci, 
and strategy of SASS will be considered in light of their potential contribution to improving 
schools. 

If the value of SASS is to be measured by its contributions to school improvement, it 
is necessary to define what is meant by school improvement. To begin, distinctions must 
be made among (a) changes in policies that are designed to improve schools, (b) changes 
in programs and practices that are designed to improve schools, and (c) changes in school 
performance reflected in indicators such as outcome measures (e.g., higher achievement 
test scores), resource efficiency measures, school climate measures, and approval ratings 
by stakeholders (e.g., parents, the public). Ordinarily, 

• Changes in policy are expected to result in changes in programs and practices that 
conform to the new or revised policies and, in turn, 

• Changes in programs and practices are expected to result in improved school perfor- 
mance. 

It is well known, however, that (a) changes in policies (ordinarily construed as, and 
intended to be, improvements) do not necessarily result in changes in programs and 
practices, and (b) changes in programs or practices (often construed as, and intended to 
be, improvements) do not necessarily result in improved indicators of school performance. 
Therefore, the intent of policy makers and educators to improve policies, programs, and 
practices by implementing changes is not certain to reap the desired effects on school 
performance. Whether such changes actually affect school performance is an empirical 
matter, subject to systematic measurement such as by standardized achievement tests. 
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Furthermore, there is even a problem in determining what actions or conditions 
constitute "school improvement" because this involves judgment. What some regard as 
an improved policy, program, or practice, others may view as a reversal. For example, 
some view private school vouchers as a promising policy reform, while others regard them 
as a basic threat to public schools (Jennings & Stark, 1995). In contrast, there is often 
consensus about what changes in school performance represent improvement, such as 
rising academic achievement scores. Even so, judgements differ about whether some 
changes in school performance represent improvement--as evidenced by the conflict in 
several states over outcomes-based education. 

The upshot of this line of thinking is that it will be more useful and productive to 
translate the concept of "school improvement" to that of "school change," and to 
determine whether changes in policies, programs, and practices actually lead to changes in 
school performance. Let others (policy makers, professional educators, the press, and the 
public) debate whether changes observed actually represent improvement. In contrast, 
SASS should be used to make major contributions to understanding various changes in the 
interlocking sequence of policies, programs, practices, and performances by establishing 
baseline status data and monitoring changes from these baselines over time. 3 Specifical- 
ly, SASS can be used to: 

• Monitor Changes in Policy. With respect to policy changes, SASS has not monitored 
the status of, or changes in, federal and state education policy. However, SASS has 
and can continue to monitor the status of, and changes in, policies at the local 
education agency (LEA) level through the Teacher Demand and Shortage Question- 
naire. One value of monitoring the status of, and changes in, LEA policies is to 
determine how policies at the federal and state levels are being interpreted and 
translated into local policy. Another value of monitoring LEA policies is to determine 
how well programs and practices at the school level conform to LEA policies. 



3 ln fact, baseline status data may often be of more value in informing broad education policy 
than data on changes from baseline. Therefore, when this paper discusses changes in school 
policy, programs, practices, and performance, it should be understood that establishing baseline 
status data is a necessary and integral part of measuring change. 



• Monitor Changes in Programs and Practices . SASS has and can continue to monitor 
the status of, and changes in, programs and practices at the LEA and school levels 
through the Teacher Demand and Shortage Questionnaire and the School Ques- 
tionnaires. One value of monitoring the status of, and changes in, programs and 
practices is to determine how well they are conforming to federal, state, and local 
policies. Another value of monitoring the status of, and changes in, programs and 
practices is to measure many of the dimensions of schooling which impact on school 
performances. 

• Monitor Changes in Performance Indicators . SASS has and can continue to monitor 
the baseline levels of several indicators of school performance, and changes from 
these baselines, through the School, Principal, and Teacher Questionnaires. 4 Though 
most school performance indicators are measured by instruments other than SASS, 
SASS nonetheless serves a special role in monitoring some school performance indica- 
tors (such as school climate) because SASS is the most direct, and possibly only, 
source of such national data available. 

Change in school policies, programs, practices, and performances is used here as a 
generic concept to include school improvement, reform, and restructuring, since all such 
initiatives entail various forms of change. Clearly, it is not possible to predict many of the 
school improvement, reform, or restructuring initiatives that will continue, or be initiated, 
in the coming two decades. Who could have predicted in 1 983 the variety and form of 
such initiatives that were taken in the decade following publication of A Nation at Risk ? 
Thus, it will not be prudent to redesign SASS to monitor specific current reforms per se 
(such as systemic reform). Instead, SASS should monitor the fundamental dimensions of 
schooling that are amenable to manipulation by public policy for the purpose of improving 
school performance. 

Considering that SASS is an instrument for collecting basic data on schooling and is 
scheduled to be administered only every five years in the foreseeable future, it should be 



4 The major examples are school attendance and completion items in the School Questionnaires, 
and school climate in the Principal and Teacher Questionnaires. 



designed to cover essential, enduring aspects of schooling that will be of continuing impor- 
tance, as distinguished from covering specific reforms or current narrow issues. For 
example, if SASS monitored the character of, implementation of, and changes in curricu- 
lum frameworks, student assessment, and teacher preparation (both pre- and inservice), it 
would be monitoring fundamental dimensions of schooling that, as a group, are basic 
components of systemic reform. In the event that systemic reform, as such, proves to be 
a passing fad within a few years, SASS will nonetheless have tracked three fundamental 
dimensions of schooling that are likely to be relevant to future educational policy. 

As noted previously, policy-based changes in such dimensions might be viewed by 
some as constructive reforms, and as reversals by others. Therefore, as a public agency 
dedicated to collecting and reporting unbiased statistical information, NCES should not 
appear to be an advocate for or against any reform. Furthermore, the publication of major 
reports of information based on SASS data usually requires four years from the time of 
questionnaire design— all the more reason for SASS to concentrate on fundamental dimen- 
sions of schooling that will be of enduring interest instead of concentrating on any current 
high-profile reform initiative. 

III. THE GOALS, FOCI, AND STRATEGY OF SASS: A RECONSIDERATION 
Past SASS Goals, Foci, and Strategy 

Since its inception in 1987-88, the goals, foci, and strategy of SASS can be charac- 
terized as follows: 

• Goals: The primary goal of SASS has been to provide data "that will contribute to the 
development of sound educational policies at all levels of government" (NCES, 1994, 
p.2). SASS has also served as a source of national and state data about schools and 
their staffing for educators and researchers. 

• Foci : SASS has focused primarily on the teaching force (K through 1 2) and second- 
arily on school polices, programs, and administrators. Its distinctive strength 



has been the comprehensive data collected about teacher characteristics, qualifica- 
tions, and attitudes, and about teacher demand, supply, turnover, and workplace 
conditions. These aspects of the teaching force are referred to collectively in this 
paper by the expression "teacher supply and demand.” 

• Strategy : The strategy adopted for SASS has been to collect detailed descriptive data 
about schools and their staffing, as distinguished from collecting data to test specific 
hypotheses or to evaluate specific policies, programs, or practices. This strategy is 
particularly suited to the sample survey method, and is in keeping with NCES's 
mission to collect, analyze, and disseminate education statistics. 

It is these basic attributes of SASS that should be reconsidered in its redesign, along with 
the implications for questionnaire content. 

Future SASS Goals 

The goals of SASS should continue to be the collection of data that will contribute to 
the development of sound education policies at all levels of government and that will be 
useful to educators and researchers. Changes in SASS for 1 998-99 should be made in its 
foci and strategy, and in questionnaire content that follow from decisions about foci and 
strategy. 

Future SASS Foci 

The fundamental question in redesigning SASS is whether the current primary focus 
on collecting data about teacher supply and demand should be maintained or modified. 
Major candidates for alternative foci are instruction, school governance, and school 
organization. In reconsidering the foci of SASS, the following guiding principles should be 
observed: 

* The importance of continuity in data collected in previous administrations of SASS 
should be recognized. In light of previous investments in establishing baseline data 
and changes over time in numerous dimensions fundamental to schooling, continuity 
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should be valued highly. Therefore, the redesign of SASS should not start with a 
clean slate. 

• SASS data that will be of maximum value to policy makers and others in describing 
basic dimensions of schooling and in monitoring change over time in these dimensions 
should be of high priority. In deciding what educational phenomena are sufficiently 
important to quantify, the following guidelines can be used: 

° Select fundamental aspects of schooling that have been the subject of major policy 
action in the recent past , such as teacher preparation and qualifications, school 
accountability, decentralization of authority, deregulation, instructional technology, 
and the like. Such topics are likely to be of policy interest in the next decade or 
two. 

° Select fundamental aspects of schooling that have been the subject of recent policy 
analysis and debate , but only of minor policy action to date, such as contracting for 
school management and instruction (i.e., privatization), and vouchers for private 
school tuition. Some such topics are likely to attract major policy action in the 
future. 

° Select aspects of schooling of major public concern such as instruction in basic 
skills, student discipline, and school safety. 

• The roles and contributions of other NCES surveys should be recognized, especially 
those that collect data about basic dimensions of schooling and monitor change in 
these dimensions. Even though certain data may be of critical importance, SASS 
should not ordinarily collect data that are available from other sources. 

These principles for reconsidering the foci of SASS will be used later in analyzing 
alternative emphases that might be employed for the design of the fourth administration of 
SASS. 

Future SASS Strategy 

In keeping with NCES's mission to collect, analyze, and disseminate education 
statistics, the strategy adopted for SASS has been to collect detailed descriptive data 
about schools and their staffing. Without challenging NCES's statutory mission, however, 
it is useful to examine three potential uses of descriptive data in policy development . They 
are: 
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• Use of Descriptive Data for Problem Definition . Since policy is formed in response to 
problems (either actual or imagined), one policy-relevant function of descriptive data is 
to quantify phenomena objectively so that judgments can be made as to whether, and 
to what extent, a problem exists. In this respect, SASS data have been particularly 
useful in defining (i.e., quantifying) potential problems requiring policy intervention, 
such as teacher qualifications, turnover, and shortage (Bobbitt & McMillen, 1 995; 
Bobbitt, Leich, Whitener, & Lynch, 1994). For example, SASS data have shown that 
the percentage of teaching positions that are not filled is less than one-half percent 
(Choy, Henke, Alt, Medrich, & Bobbitt, 1993). Thus, there does not appear to be a 
serious shortage of individuals available to be appointed as teachers. However, SASS 
data have also shown that about 6% of teachers overall do not hold full certification 
in their main teaching assignment. This can be taken as evidence of a significant 
shortage of qualified teachers. This problem can be defined even more precisely by 
computing this shortage percentage by main teaching assignment. 

• Use of Descriptive Data for Evaluation of Policies and Programs . Without collecting 
evaluation research data specifically, descriptive statistical data might be used by 
agencies other than NCES (e.g., by policy analysts located at various governmental 
agencies and private organizations at all levels) to evaluate policies and programs. For 
example, descriptive data routinely collected on the authority vested in school 
councils (where such exist) could be used to assess the extent of implementation of a 
state-wide policy to create school councils with authority to make teacher hiring deci- 
sions. 5 In addition, SASS could collect data about the judgments of principals and 
teachers on the workability, utility, and acceptability of policies such as those 
devolving teacher hiring decisions to the school level. Data might also be collected on 
teacher behavior. For example, if it is decided to monitor a policy requiring a school 
improvement plan every other year, data might be collected from teachers about their 
participation in, and contributions to, such planning. Data thus collected about the 



E The Public School Questionnaire of SASS's third round already collects information about 
several functions of school councils. 



judgments and behavior of principals and teachers might provide insights into why 
some policies seem to be implemented and produce desired effects, and why others 
appear not to. Finally, some descriptive data relevant to school performance (e.g., 
school absences, as already collected by SASS's school questionnaires) are relevant 
to evaluating policy effects-though, as previously observed, most measures of school 
performance must come from sources other than SASS. 

• Use of Descriptive Data for Enlightenment . Apart from having immediate and specific 
relevance to defining policy problems and to evaluating policy implementation, SASS 
has also collected much new background data about schools and staffing that is 
useful to policy makers and others in fostering a broad understanding of the phenome- 
na addressed (i.e, the "enlightenment" function of research and statistical information 
as described by Weiss, 1977). According to Shavelson (1988), the central value of 
educational research findings (and presumably the systematic collection of statistics) 
lies in their ". . . constructing, challenging, or changing the way policymakers and 
practitioners think about problems" (pg. 4). For example, research on teacher 
turnover based on SASS data has contributed to a better general understanding of the 
components, complexities, and magnitude of this phenomenon (Ingersoll, Han, & 
Bobbitt, 1995). 

SASS's current design emphasizes the problem definition and enlightenment uses of 
data collected, and to minimizes SASS's relevance to evaluation of policies and programs. 
While the problem definition and enlightenment functions of SASS data should be 
continued, it is recommended that NCES, in the redesign SASS, attempt to collect more 
data relevant to the evaluation function as well. 

IV. DIMENSIONS OF SCHOOLING AMENABLE TO POLICY INTERVENTION 

The identification of fundamental dimensions of schooling that are likely to become 
the subject of policy interventions is understood here to be equivalent to NCES's concept 
of "emerging educational issues." In commissioning this paper, NCES asked "What 
emerging educational issues are likely to be important in the coming years and how can 
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SASS data inform our understanding of these issues?" This section of the paper is 
devoted to identifying both "emerging issues" and "enduring issues" that are amenable to 
policy intervention. Enduring issues, as well as emerging issues, will be considered 
because SASS may not have addressed (or sufficiently addressed) either type. The second 
part of NCES's question, pertaining to "how can SASS data inform our understanding," 
will be addressed in a subsequent section. 

As addressed in this paper, the fundamental dimensions of schooling are classified 
into five main categories: school governance, instruction, educational finance, school 
infrastructure, and school staffing (principals and teachers). Because the first three 
administrations of SASS emphasized school staffing, a subsequent section of this paper is 
devoted to consideration of this major topic. Therefore, this section of the paper concen- 
trates on the other four categories (school governance, instruction, educational finance, 
and school infrastructure). 

Fundamental dimensions of schooling vary in the degree to which they are amenable 
to policy intervention. For example, the teacher-pupil ratio is directly amenable to policy 
intervention, while the social character of teacher-pupil interactions is not, even though the 
latter may have much greater effect on academic achievement and other valued student 
performances. Since a primary consideration in the redesign of SASS is to inform broad 
education policy pertaining to schooling in the next two decades, the objective of this 
section is to identify those fundamental dimensions of schooling which have a reasonable 
prospect of being taken seriously in future policy formation. Such dimensions might be 
relevant to both current policies (possibly under reconsideration for modification or 
discontinuation) and to the formation of new policy. 

To identify fundamental dimensions of schooling that are likely to be targets of policy 
formation in the next two decades, some explicit criteria are required. Such dimensions 
were identified here by meeting any one of the following criteria: 

• Dimensions of schooling that have been the target of major policy formation in the 
past, especially the past ten years or so. 
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